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Abstract 



This paper examines the objective of optimally harvesting a sin gle speci e s in a 
stochastic environment. This problem has previously been analyzed in lAlvarezI (l2000h 



using dynamic programming techniques and, due to the natural payoff structure of 
the price rate function (the price decreases as the population increases), no optimal 
harvesting policy exists. This paper establishes a relaxed formulation of the harvesting 
model in such a manner that existence of an optimal relaxed harvesting policy can not 
only be proven but also identified. The analysis imbeds the harvesting problem in an 
infinite-dimensional linear program over a space of occupation measures in which the 
initial position enters as a parameter and then analyzes an auxiliary problem having 
fewer constraints. In this manner upper bounds are determined for the optimal value 
(with the given initial position); these bounds depend on the relation of the initial 
population size to a specific target size. The more interesting case occurs when the 
initial population exceeds this target size; a new argument is required to obtain a sharp 
upper bound. Though the initial population size only enters as a parameter, the value 
is determined in a closed-form functional expression of this parameter. 
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1 Introduction 

This paper examines the problem of optimally harvesting a single species that lives in a 
random environment. Let X be the process denoting the size of the population and Z 
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denote the cumulative amount of the species harvested. We assume X(Q—) = xq > 0, 
Z(0—) = 0, and X and Z satisfy 



dX(t) = b(X(t))dt + a(X(t))dW(t) - dZ(t), 



in which W(-) is a 1-dimensional standard Brownian motion that provides the random fluc- 
tuations in the population's size, and b and a are real-valued functions. We assume that 
b and a are such that in the absence of harvesting the population process X takes values 
in R + and that oo is a natural boundary so that the population will not explode to oo in 
finite time. The boundary may be an exit or a natural boundary point but may not be an 
entrance point; this indicates that the species will not reappear following extinction. Note 
that X(0) may not equal X(0— ) due to an instantaneous harvest Z(0) at time and the 
process Z is restricted so that AZ(t) := Z(t) — Z(t—) < X(t—) for all t > 0. This latter 
condition indicates that one cannot harvest more of the species than exists. Let r > denote 
the discount rate and / denote the marginal yield for harvesting. The objective is to select 
a harvesting strategy Z so as to maximize the expected discounted revenue 



J(x ,Z) :=E a 



e- rs f(X(s-))dZ(s) 



;i-2) 



where r = inf {t > : X(t) =0} denotes the extinction time of the species. 

As a result of developments in stochastic analysis and stochastic control techniques, 
there has been a resurgent interest in determ ining the optimal h a rvesti n g strategie s in th e 
presence of stochastic fluctuations (see, e.g.. lAlvarez and Sheppl (|1998l): iBraumanl (|2002l) ; 
Jprgensen and Yeune ( 1996 ): Lungu and 0ksendal f 19971 . 12OOI ); Ryan and Hanson f 19861 )). 
In particular, lAlvarezI ( 120001 ) examines the current problem using dynamic programming 
techniques and determines the value function. The paper indicates the lack of an optimal 
policy in the admissible class of (strict) harvesting policies by commenting that a "chattering" 
policy will be optimal. The p roblem of optimal harvesting of a single species in a random 
environment is also studied in ISong et al.l (l201l[ ) in which the model is extended to regime- 
switching diffusions so as to capture different dynamics such as for drought and non-drought 
conditions. The paper also adopts a dynamic programming solution approach to determine 
the value function while a t the same tim e exhibiting e-optimal harvesting policies since, as in 
the static environment of lAlvarezI (120001 ). no optimal harvesting policy exists. In light of the 
complexities of the regime-switching model, it further identifies a condition under which the 
value function is shown to be continuous and a viscosity solution to the variational inequality. 

The focus of this paper is on developing a relaxed formulation for the harvesting problem 
under which an optimal harvesting control exists and on establishing optimality using a lin- 
ear programming formulation instead of dynamic programming. In addition, it is sufficient 
to have a weak solution to (II -ip rather than placing Lipschitz and polynomial growth con- 
ditions on the coefficients b and a that guarantee existence of a strong solution. Intuitively, 
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relaxation completes the space of admissible harvesting rules by allowing measure-valued 
policies. A benefit of the linear programming solution methodology is the analysis concen- 
trates on the optimal value for a single, fixed initial condition, rather than seeking the value 
function and thus no smoothness properties need to be established about the value as a 
function of the initial position. 

To set the stage for the relaxed singular control formulation of the model, let T> = C^(M. + ) 
and for a function define the operators A and B by 

Ag(x) = ^a 2 (x)g"{x) + b(x)g'(x), and (1.3) 

{ g(x-z)-g(x) -r . r. 

A ' ' (1.4) 

where x,zG K.+. Ito's formula then implies 

g(X(t)) = g(x )+ [ Ag(X(s))ds + [ Bg(X(s), AZ(s)) dZ{s) 

Jo Jo 

+ / a(X(s))g'(X(s))dW(s), WgeV. 
Jo 

It therefore follows that for any g G "D 

g(X(t))-g(x )- [ Ag(X(s))ds- [ Bg(X(s), AZ(s)) dZ(s) (1.5) 
Jo Jo 

is a mean martingale. In fact, requiring ( 11. 5p to be a martingale for a sufficiently large 
collection of functions g is a way to characterize the processes (X, Z) which satisfy ( 11.11) . We 
turn now to a precise formulation of the model in which the processes are relaxed solutions 
of a controlled martingale problem for the operators (A, B). 



1.1 Formulation of the Relaxed Model 

For a complete and separable metric space S, we define M(S) to be the space of Borel 
measurable functions on S, B(S) to be the space of bounded, measurable functions on 
S, C(S) to be the space of continuous functions on S, C(S) to be the space of bounded, 
continuous functions on S, JA(S) to be the space of finite Borel measures on S, and V(S) 
to be the space of probability measures on S. J\4(S) and V{S) are topologized by weak 
convergence. 

Recall, the amount of harvesting is limited by the size of the population. Define 1Z = 
{(x, z) : < z < x, x > 0}; 1Z denotes the space on which the paired process (X, Z) evolves 
when considering solutions of ( II. ip . 

The formulation of the population model in the presence of "relaxed" harvesting policies 



adapts the relaxed formulation for singular controls given in Kurtz and Stockbridgel ( 20011 ) 
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to the particulars of the harvesting problem. This adaptation sets the state space E to be 
R + and the control space U = R+, with hi = 1Z C IR+ x R + . We begin by specifying the 
space of measures for the relaxed harvesting policies. Let C t {lZ) = M.(1Z x [0, t]). Define 
C(TZ) to be the space of measures £ on 7?. x [0, oo) such that £(7£ x [0,£]) < oo, for each t, 
and topologized so that £ n — > £ if and only if J / cf£„ — > J fd£, for every f E C(1Z x [0, oo)) 
with supp(/) cKx [0,t/] for some t/ < oo. Let £ t G C t (7Z) denote the restriction of £ to 
7?. x [0,£]. Note that a sequence {£ n } C C(JZ) converges to a £ G £(7?.) if and only if there 
exists a sequence with t fc — >■ oo, such that, for each t k , converges weakly to £ tfc , 

which in turn implies £™ converges weakly to £ t for each i satisfying £(1Z x {t}) = 0. 

Let X be an M + -valued process and V be an £(7£)-vamed random variable. Let T t denote 
the restriction of T to TZ x [0, t]. Then (X, T) is a relaxed solution of the harvesting model if 
there exists a filtration {J 7 *} such that (X, T t ) is {J-fj-progressively measurable, X(0) = xo, 
and for every §eD, 

g(X(t))- [ Ag(X(s))ds- I Bg( Xl z)T(dx x dz x ds) (1.6) 

</7?.x[0,t] 

is an {J^l-martingale, in which the operators A and B are given by (11.31) and (II. 4p . respec- 
tively. Throughout the paper we assume that a relaxed solution (X, V) exists and that for 
each given r, the associated X is uniq ue in distribution. Consequently, X is a strong Markov 
process (see ( Ethier and Kurtzl . Il986l . Theorem 4.4.2)). Let A denote the set of measures T 
for which there is some X such that (X, T) is a relaxed solution of the harvesting model. 

A couple of observations will help the reader to understand this relaxed formulation 
for the model. First, consider the solution (X, 0) in which the measure-valued random 
variable T = so it ha s no mass and thus no harvesting occurs. Then Theorem 5.3.3 of 



Ethier and Kurtzl (119861 ) shows the existence of a Brownian motion W adapted to a possibly 



enlarged filtration {J-i} such that the process X satisfies (II. ip with Z = 0. Next, let Z 
denote a "strict" harvesting policy; that is, Z is a nonnegative, increasing process that is 
cadlag and adapted to {Ft}- Define the random measure T for Borel measurable G C TZ and 
t > by 

r(Gx[0,f])= / I G {X{s-),AZ(s))dZ{s). (1.7) 
Jo 

It then follows that (X, T) will be a relaxed solution of the harvesting model whenever (X, Z) 
satisfies (II. 1ft . 

We turn now to the extension of the reward criterion (II. 2p to the relaxed framework. 
Specifically, / : R + h-> M + represents the instantaneous marginal yield accrued from har- 
vesting. Assume / is continuous and non- increasing with respect to x. Thus f(x) > f(y) 
whenever x < y; this assumption indicates that the price when the species is plentiful is 
smaller than when it is rare. Moreover, we assume < /(0) < oo. Let (X, T) be a solution 
to the harvesting model (II. 6p . Let S = (0, oo) be the survival set of the species and denote 
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the extinction time by r = inf{t > : X(t) S}. Then the expected total discounted value 
from harvesting is 



J{x ,T) :=E 



e rs f(x) T(dx x dz x ds) 

Kx[0,t] 



The goal is to maximize the expected total discounted value from harvesting over relaxed 
solutions (X, T) of the harvesting model and to find an optimal harvesting strategy T*. Thus, 
we seek 

V(x ) = J(x , P) := sup J(x , r). (1.9) 

re.4 

We emphasize that the initial position xq is merely a parameter in the problem and that V 
is not to be viewed as a function with any particular properties but merely is the value of 
the harvesting problem when the initial population size is Xq. We do, however, obtain the 
value in functional form for Xq in two regions. 

2 Linear Programming Formulation and Main Result 

Throughout this paper, we assume the equation (A — r)u(x) = has two fund amental 



solutio ns ip and 0, where ip is strictly increasing and is strictly decreasing. As in lAlvarez 
fhoooh . we put 

{ip(x), if is natural or exit, 

ip(x) — ^t^0 ( x ), if is regular. 

Note that ip solves (A — r)u(x) = 0, is strictly increasing, and satisfies ^(O) = 0. 
The main result of this paper is summarized in the following theorem. 

Theorem 2.1. Assume that there exists some b > such that 
(i) 

#^<^, Vx>0, (2.1) 

(ii) the function is nonincreasing on [6, oo), and 

(iii) the function f is continuously differentiable on (b, oo). 

Put b* = inf{6 > : b satisfies (i)-(iii)}. Then the value is given by 

VM=< l ib) (2.2) 
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and an optimal relaxed harvesting policy is given by 



T*(dx x dz x dt) = In,* t oo){xo) A[6* ) xo ](dx)8{o}(dz)8fQ\(dt) + Tb*(dx x dz x dt), (2.3) 
where \\b*,x ](') denotes Lebesgue measure on [b*,x ] and T b * is defined in Proposition \'S.5i 



Theorem ET] is obtained in lAlvarezI (120001 ) using the dynamic programming approach: the 
value function V is obtained by explicitly solving a quasi- variational inequality of Hamilton- 
Jacobi-Bellman type by first using a heuristic argument to obtain V and then verifying the 
validity of the argument. In this paper, we use a totally different approach by imbedding 
the problem in a linear program over a space of measures to establish Theorem 12.11 In this 
approach, there is no need to establish the regularity of the value function, and therefore no 
heuristic arguments or HJB equation are needed. More specifically, we will first derive upper 
bounds for the value (depending on xq), and then find a harvesting policy which achieves 
the appropriate upper bound. 

The measures involved in the infinite-dimensional linear program are expected, dis- 
counted occupation measures corresponding to relaxed solutions (X, T) of the harvesting 
model. Indeed, for any Borel measurable G\ C S and G C 7Z, we define 



f, T (Gi) = E[e- rT I Gl (X(r))I {T<oo} ] 



t i o{G\ / 
/ii(G) 



E 



e- rs I Gl {X{s))ds 



(2.4) 



E 



e ts Ig{x, z)T(dx x dz x ds) 



7£x[0,7 



Using these measures, the singular control problem of maximizing ( II. 8ft over relaxed solutions 
of the harvesting problem ( 11.611 can be written in the form 



Maximize J fdfii, 

subject to / 9d , T -J (A- r )g ^ - J Bgdfii = gM , V 9 e V, ^ 
fj. T ,(J>o, and fjLi are finite measures with (jl t (S) < 1 and /xo(S') < -• 



Since each relaxed solution (X, T) defines measures fi T , /io and \i\ by ( 12. 4p . the harvesting 
problem is embedded in ( 12. 5ft . There might be feasible measures which do not arise in this 
manner. Consequently, letting Vi p (xo) denotes that value of the LP problem (12.5p with initial 
condition X(0— ) = xq > 0, we have 



V(x ) < V lp (x ). 



(2.6) 
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3 The Proof of Theorem 
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This section is devoted to the proof of Theorem 12.11 We consider two different cases: when 
< xq < b* and when xq > b*, where b* is the threshold level given in the statement of the 
theorem. 



3.1 Case 1: < x < b* 



Our goal is to find the value V(x ) defined in (11. 9p and a relaxed optimal harvesting policy 



direct ly. The proof follows along the lines of the arguments used in iHelmes and Stockbridge 



( 120111 ). In fact, an optimal strict harvesting policy Z is obtained so the relaxed formulation is 
not necessary in this case. The general argument involves finding an upper bound for Vi p (xq) 
by reducing the number of constraints in the linear program (I2.5P and then identifying a 
solution (X*,Z*) which achieves the bound. The relaxed harvesting policy T* is obtained 
from Z* by (TOD . 



We will need the Skorohod lemma (see iLions and Sznitmanl (11984] )) so we give its state- 
ment for completeness. 

Lemma 3.1. Given any initial state Xq and any boundary c, there exists a unique {J~"t}- 
adapted cadlag pair (X, L c ) such that L c is nonnegative and nondecreasing and 

X(t)=x + [ b(X(s))ds+ [ a(X(s))dW{s)- L c (t), (3.1) 
Jo Jo 

X(t) G (— oo,c], for almost all t>0, (3-2) 

"OO 

I{x(s)<c}dL c (s) = 0. (3.3) 

o 

Moreover, L c is continuous if xq < c. 

The solution X to the above equations is a reflected diffusion at the boundary c, and the 
process L c is the local time process of X at c. Moveover, the property (13.31) shows that the 
process L c increases only when X reaches the boundary c. 

Proposition 3.2. Let < x < b* . Then 

v(x x _ gMW 
v{xo) ~ ' 

and an optimal harvesting strategy is given by the local time process Lb* of X* at b* . 



Proof . Though ip does not have compact support, an argument similar to the one in lHelmes and Stockbridg 



( 120111 ) shows we may use the function ip in the constraints of (12.51) . This results in an aux- 
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iliary linear program 

Maximize / fdfii, 



subject to — J Bipd[ii = ip(xo), (^-^) 
is a finite measure. 

In obtaining the auxiliary linear program we have used the properties that ^(0) = and 
(A — r)ip(x) = to eliminate the measures \x T and /j,q from the program. Denote the solution 
to ( 13. 4p by V aux (x ). Then since fl3.4[) has fewer constraints than (JUS}, the set of feasible 
measures \i\ for ( 13. 4 p may contain more \x\ measures than those arising from the feasible 
solutions to (12. 5p and hence 

V(x ) < V lp (x ) < V aux (x ). (3.5) 
Using the definition of B in (II. 4p . the constraint in (13. 4p can be written as 

^Oo) = - / Bipdfji! = [ (i)'(x)I {0} (z) + ^tfc —ha,x]{z) J midx x dz). 



1Z 



Recall that ip is strictly increasing and ^>(0) = 0. Therefore if)(xo) > and hence it follows 
that 

tm^i±^f^i lMdx x dz) . 

Thus the integrand is a probability density relative to any feasible measure /ii and defines 
a corresponding probability measure jli on TZ. Now the objective function (ll.Sp can be 
rewritten as 

/ fd ^ = I TTTTt ( V ZWE^EA t — 7~\ h{ - dx x dz) - (3 - 6) 

J J lp'{x)I {0} {z) + VV > f L I(0,x]{Z) 

We claim that 

m < mi (3 7) 

In fact for z = 0, ( 12. ip and the definition of b* in the statement of Theorem 12.11 implies 

f(x) fix) f(b*) 



On the other hand, for z ^ 0, then the assumption that / is nonincreasing along with (12. ip 
implies that for some 9 G [0, 1] 

fix) _ f(x)z = fjx)z 

il/(x)I { o } (z) + ^ x) -f x - z) I {0tX] (z) ip(x)-ip(x-z) V{x-Bz)z 

f(x - dz) fix) < fjx - 6z) < /(&*) 



ip'ix - ^) /(ar - 6z) ~ ip'ix - 0z) ~ ^'(6*) ' 
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Now it follows from (13. 6p and the bound in (13. 7p that for any feasible measure /ii of (13.41) 



/ fd[ix - L 



and hence 



fttf) „ f(b*) 
fdfi! < I ■^rip{x )jl 1 {dx x dz) < —-$( Xq ), 



V aux (x ) < l^-^(x ). 



(3. 



Next we show that there is an admissible (strict) harvesting strategy Z* and therefore a 
relaxed harvesting strategy r* G A such that 



J(x ,Z*) = J(x ,T* 



f(b*) 
ip'(b*' 



(3.9) 



Recall, we are analyzing the case in which xq < b*. Let (X*,L b *) be the solution to the 
Skorohod problem ( 13.1l) -( j3~3l of Lemma l3~Tl with c = b*. Note that L b * is continuous and 
hence X* is also continuous. Next for any t > 0, by virtue of Ito's formula and (13.31) . we 
have 



E K0 [e-^ A4 V(X*(rAt))]-^(x ) 

rr/\t prAt 

e- rs (A-r)ij(X*(s))ds- / e~ rs %lj\X*(s))dL b »(s) 
li) Jo 

e- rs dL b ,(s) 



E, 



-V'(6*)E 



(3.10) 



Due to the process X* being bounded (from (13.21) ). ip(X*(t)) is also bounded for all t > 0. 
This observation along with the fact that ^(O) = then implies 



limE x . [e-^ A *V(X*(rAt))] 

lim E X0 [e- H i>(X*(t))I {T=oo} + e- r ^ A 'V(X*(r A t))I {r<oo} ] = 0. 



t— >oo 



Hence by letting t — > oo in (13.101) . it follows that 



E 



i)'{b*y 



which in turn implies that 



J(x ,L b *) = E XQ 



f e- rs f(X*(s))dL b *(s) 
Jo 



r e - rs dL b ,(s) 

Jo 



f{b*)jj{x ) 

i>'{b*) 



Therefore fl32]) follows with Z* = L b *. Defining T* by (jT7)) . the pair (X*,T*) is a relaxed 
solution of the harvesting model which achieves the bound. □ 

Since AL b *(s) = for every s > 0, an optimal strategy is to harvest just enough of the 
population (using the local time of X* at b*) so that the population size "reflects" at b*. 
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3.2 Case 2: x > b* 



This case is the more interesting of the two cases and requires a new argument and also a 
different type of harvesting policy than what appears in the literature. It is for this case 
that the relaxed formulation of the problem is needed in order to obtain an optimal control. 

When dealing with singular control problems, one usually takes the so-called reflection 
strategy, namely, 

Z(t) = (x -b*)+ + L b *(t), (3.11) 

where one uses the local time process Lh* at b* following a n imm e diate jump from xq to 
b*. Such a reflection strategy is used in lChoulli et al.l (120031 ). iPhaml (120091 ) and others. The 
income corresponding to (13.111) is 



J(x Q ,Z) = f(xo)(x - b* 



ip'(b*) 



When / is strictly decreasing, then the reflection strategy i s not optim a l. In fact, there is 
no strict admissible optimal harvesting strategy; please see ISong et al.l (120111 ) for detailed 
arguments as well as the explicit construction of an e-optimal admissible harvesting policy 
for a regime-switching diffusion (the static environment model of this paper being a special 
case) . 

Our purpose is to find an optimal relaxed harvesting strategy. The previous section 
proves V(x ) < /( y ( t ( ) 0) - However, the upper bound is a strict upper bound; no relaxed 
harvesting policy will achieve this upper bound. The following arguments determine a sharp 
upper bound. We begin by establishing the following estimate. 

Lemma 3.3. Assume the conditions in Theorem U.li Denote 



g(x) :-- 



f{y)dy, forx>b*. 



Then 



[A — r)g(x) < r — — > J or ever V x > b . 



(3.12) 



(3.13) 



Proof. Since the function f/if)' is nonincreasing on (b*, oo), we have 

d ff{x)\ f'{xW{x)-f{x)r{x) 



> — 



dx \i/j'(x) 



x > b*. 



But ip is strictly increasing and so ip'(x) > 0. Hence it follows that f'(x)tp'(x) — f(x)ip"(x) < 
0, or equivalent ly 

f{x) < T^\r(x), for x > b\ 
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It then follows that for each x > b* 

(A - r)g{x) = \a 2 {x)f\x) + b{x)f{x) - r f ^^{y)dy 



1 



— o " i x )f'{ x ) + K x )fi x ) ~ r 



x m 



- r 2{x) {^/ {x) + b{x)f{x) - r w$)^ x) ~ ^ )] 



f( x ) 



-a 2 (x)ip" (x) + b(x)il)\x) — rtp(x) 



ip'[x 



□ 



The next result establishes a sharper upper bound on the value of the problem. This 
upper bound will be seen to be the value of the harvest for a relaxed solution of the harvesting 
model and hence establishes the value. 



Proposition 3.4. Let Xq > b* and assume the conditions of Theorem \2.1[ Then 

f(b*W(b*) 



:>■<) 



VM<1 /(</)*/ + nb , } ■ 

Proof. Let (X, T) be an arbitrary solution to the harvesting model (11.61) and define 

T 6 * = inf{t > : X(t) < b*} 

and observe that r&* < r. The rest of the proof is divided into several steps. 
Step 1. We claim that 

f{b*mb*) 



(3.14) 



J(x 0} T)<E X0 
To establish ( I3.15p . we write 



e rs f{x)T{dx x dz x dt) 



ip'(b* 



-E X0 [e~"»] . (3.15) 



J(x ,T) = E 
= E 



e rs f(x)T(dx x dz x ds) 



J-t) 



/ e rs f(x)T(dx xdzx ds)(I {Tb , =oo} + I{ Tb ,<oo}) 

Jkx[0,t] 



(3.16) 



Clearly on the set {t^* = oo} we also have r = oo = r&* so the first term can be rewritten as 



E 



j-t) 



/ e rs f(x)T(dx x dz x ds)I{ nt=00 } 

.JKx[0,T b *] 



(3.17) 
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For the second term, it follows from the strong Markov property and (13. 8p that 



E 



/ e rs f(x)T(dx x dz x ds)I{ Tb , <00 } 

J11x\0,t] 

e~ rs f(x)T(dx x dz x ds) 



E 



! {t,,,<oo} 



TZx[0,T b ») 



E, 



e rs f(x)T(dx x dz x ds) 



< E 



'{T 6 »<00} 



'TZx[r b * ,t] 

e~ rs f(x)T(dx x dz x ds) 



Kx[0,T b »] 



e rs f(x)T(dx x dz x ds) 



kx[o,i 



t{r b *<co} 



Kx[0,T b * 



e- rs f(x)T(dx xdzx ds) + e- rTb *^^^(X(r b ,))] 

yj'{b*) 



where f(G x [0,t]) = r(G x [t 6 *,t 6 * -ft]) for G C TZ. But on the set {r b * < oo}, X(i>) < b*. 
Note also that i[> is strictly increasing. Thus we have 



E 



x 

.Jnx 



0,r] 



e rs f(x)T(dx x dz x ds)I{ Tbt<OQ } 



1Zx[0,T b * 



e rs f(x)r(dx x dz x dt)I^ <oa ^ 



(3.18) 



Finally a combination of (I3.16p - (l3.18p implies A3. 15[) . 

Step 2. Since / is nonincreasing, for any x, 5 > with x — 5 > b* , we have 



f(x)5< / f(y)dy = g(x) - g(x - 5). 

Ix-S 



Therefore it follows that 



E 



_Jnx[o,T b 
E 



-'TO 



e rs f(x)T(dx x dz x dt) 

e~ rs f(x)T(dx x dz x dt) 



.x{0}x[0,T b * 



+E 



■i'O 



e -rsf^_ T ^ dx X(Jzx df j 



< E 



,r 



+E 



L^(^-(R+x{0}))x[0,r 6 ,] 2 

e~ rs f(x)T(dx x dx x dt) 

„-r,9(x)-g(x-z) 



.x{0}x[0,r 6 « 



F(dx x dx x dt) 



(^-(R+x{0}))x[0,r b »] 
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Recalling the definition of B in (11. 4p . we observe that Bg(x,0) = —g'(x) = —f{x) and 
gMzg(gzf) = —Bg(x 1 z) when z > and hence 



E 



■Co 



e rs f(x)T(dx x dx x di) 



Ux [o,n*] 
< -E, 



TZx[0,T b * 



e rs Bg(x,z)T(dx x dx x di) 



(3.19) 



Step 3. We have 



-E 



e rs Bg(x, z)T(dx x dz x dt) 



UlZx[0,T b ,] 

In fact, for any t > 0, Ito's formula implies that 



<^(x )+ /( ^ ( ) y) (l-E^[ e -^]). (3.20) 



E IO [e-^ At ) 9 (X(r 6 ,Af))]- 9 (x ; 

-T h * At 

e~ rs (A - r)g(X(s))ds + / e~ rs Bg(x, z)T(dx x dx x dt) 

>1lx[0,T b * At] 



E 



XQ 



Isolating the term involving Bg and using the bound (13.131) . we have 



-E 



■t'o 



e rs Bg(x, z)T(dx x dx x dt) 



lTlx[0,T b *At] 

< g(x ) - E„(e--<'>- Al > 9 (A'(T ( ,. A ())] + E 

< S (*^(i-E,r"-l). 



:>■<) 



T b *At 



ip'(b*) 



Now (I3.20p follows by letting t — > oo in the above inequality. 
Step 4. Combining fl3TT5|) . f |3TT9|) . and f l3~20|) yields 



g(xo) + 



i/j'(b*) 
i/j'(b*) 



ip'(b* 



The bound in (I3.14p is therefore established by taking supremum over T E A. 



□ 



We have derived an upper bound for the value V{xq) in Proposition 13.41 The next natural 
question is: "Can we find an admissible optimal harvesting policy which achieves the upper 
bound specified in the right-hand side of (13.141) ?" The following proposition answers this 
question in the affirmative by explicitly constructing an optimal relaxed harvesting policy. 
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Proposition 3.5. Let \[b*, Xo ](-) denote Lebesgue measure on [b*,x]. Also let Lb* denote the 
local time process of Proposition 13.21 with x taken to be b* . Define IV to be the random 
measure defined by (11.71) using Z = Lj,* . Finally, define the relaxed harvesting strategy by 



T*(dx x dz x dt) = \[ b * xo ](dx)d~{ }(dz)5{ }(dt) + Tb*(dx x dz x dt). 



Then 



V(x ) = J(x Q ,T 



)= / f(y)dy + 



/gW) 
tp'(b*) 



(3.21) 



Proof. We observe that the measure /ii obtained from T* by ( \2A\\ is 



n\(dx x dz) = Xn,* tXQ ](dx) + 



5 {b * } (dx) x 5 {0} (dz) 



ip'(b*) 



and is feasible for (13 .4p . The measure \b*,x ](')8{o}(')8{o}(') instantaneously resets the prob- 
lem at time so that the initial position of the population becomes b*. Take (X*, L^*) to be 
the solution of the Skorhod problem from Lemma [3. II with xq = b*. It is then easy to verify 
that (X*, r*) is a relaxed solution to the harvesting model whose value equals the right-hand 



We observe that the manner in which this optimal harvesting policy differs from the 
typical "reflection" strategy occurs at the initial time. Whereas the reflection strategy has 
the process X instantaneously jump from xq to b*, the optimal relaxed harvesting policy 
obtains this relocation in an instantaneous but continuous manner. 

Finally we note that the combination of Propositions 13.21 and 13. 51 establishes Theorem 12. II 
Moreover, the optimal relaxed harvesting policy can be written as 

T*(dx x dz x dt) = I(b* ,oo)(%o) \b* ,x ](.dx)5{o}(dz)5{o}(dt) + T h *(dx x dz x dt), 

which unifies the two cases. 
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